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Abstract 

Let X and Y be two independent identically distributed random variables with 
density p(x) and Z — aX + /3Y for some constants a > and j3 > 0. We consider the 
problem of estimating p(x) by means of the samples from the distribution of Z. 
Non-parametric estimator based on the sync kernel is constructed and asymptotic 
behaviour of the corresponding mean integrated square error is investigated. 

1 Introduction 

Let Z\, Z n be i.i.d observations, where Zi = Xi + Yi and Xi and Yi are inde- 
pendent random variables. Assume that the distribution of Y's is known. The 
ordinary deconvolution problem is the problem of estimating the destribution 
of a random variables Xi from the observations Zi. In some situations (for in- 
stance, in signal processing) we don't know the distribution of Yi but rather can 
assume that Xi and Y, belong to the same class of distributions (constrained 
deconvolution). For example, Xi and Yi may be of the same multiplicative type 
(see Belomestny (2002,2003)), that is 

Zi = aXi + /3Yi, a > 0, (3 > 0, 

where Xi and Yi are now independent identically distributed random variables. 
Let distribution of Zi be absolutely continuous with density pz then the distri- 
bution of Ai(and Yi) is also continuous with some density, say p(x). Our aim is 
to construct a non-parametric estimator for p(x) based on the sample Z\, Z n 
and to study its asymptotic behaviour. 

Example Multiple Access FH SS Radio Networks systems have been consid- 
ered for a variety of applications such as military ground-based communications 
and cellular radio ( see Simon et al (1994) and Steele (1994)). In these wireless 
networks with the random multiple access protocol, because of channell reuse, 
each terminal interferes with signals transmitted by other terminals. This in- 
terference is usually referred to as multiple access or self-interference. In the 
system model , a receiver is located at the center of a plane where there are 
N transmitters (terminals). The distance between the receiver and interfering 
terminals is denoted as r^.The signal amplitude loss function over distance r is 
given by 

where the constant K depends on the transmitted power, and the attenuation 
factor m characterizes the environment. The received passband signal is 

N 



Y(t) = J2<n)Xi(t), 
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where Xi(t) is the signal from the ith interferer. Because all terminals use the 
same modulation scheme and power, it is reasonable to assume that {Xi(t)}^L 1 
for every t are independent and identically distributed (i.i.d.). The problem in 
this case can be formulated as one of reconstructing the distribution of Xi from 
the sampled distribution of Y . 



2 Main results 

Let us denote by f{t) the characteristic function of X and suppose that < a < 
(3. The characteristic function g(t) of the random variable ZJ j3 can be expressed 
as 

<?(*) = /(*)/(7*), 0< 7 = a//3<l. 
If the infinite product Yl g ^L+if) converges then 

g(j 2k t) 



m = n 



and a natural estimator for /(f) can be given as 

f a) TT 9n{l2H) (i) 



k=0 



provided that g n (t) ^ on (0,f],where g n (t) is the empirical characteristic 
function corresponding to g(t): 



1 " 

n ^ — ' 



9nW = - >e itz */e 

n ' 
fc=i 



First of all we establish some asymptotic properties of this estimator. 
Theorem 1 If~E\Z\ r < oo for some r > and g(u) ^ on (0, f] fften 

Mfn(t) f(t)) /(f) £ ^.Mt**), (2) 

fc=0 ' 

where Yp = U(t)+iV(t) is a complex valued Gaussian process with the EYp(t) = 
and with the cross-covariance matrix 



C(M) = 



(EU{t)U{s) EU(t)V(s) 
\EV(t)U(s) EV(t)V{s) 



'\[u{t - s) + u(t + s)} - u{t)u(s) \[~v{t - s) + v(t + s)\ - u(t)v{sy 
|[«(f - s) + v(t + s)\ - v(t)u(s) ±[u(t - s) - u(t + s)j - u(t)«(s) 

where u(t) and v(t) denote real and imaginary part of g(t). 

Turn now to the original problem of esimating p(x) . Taking into account JJJ ,wc 

can define the estimator for p{x) as follows 
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Pun{x) = — / e 



2tt 



-itx 



l/h n 



TT gn(7 2fc *) 



df, (3) 
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with 

l/h n = min{max{0 > : \g n (6)\ > e„}, c„}, (4) 

where e n > and c„ > are two sequences of real numbers tending correspond- 
ingly to zero and infinity as n — > oo . The exact form of e n and c n will be defined 
later. Let us further put 

d n = inf \g{s)\. 

\s\<c„ 

In the following theorem we give some results concerning the behaviour of mean 
integrated square error corresponding to the estimator J3J 



/oo 
\p(x) ~ p nN (x)\ 2 
-oo 



dx. 



Theorem 2 Let the following conditions be satisfied 
1. 

/OO 
|#| r pz(x) dx < oo, r > 
-oo 

2. p{x) G L 2 (R) 

3. 4>{t) = does noi increase on (0,oo) 

There exist A = A(r) > and D = D{r) > such that for 

e n = An- 1/2 log 1/2 n, c n < ip- 1 {2e n ), 
where <f>~ l {-) is inverse function to </>(■) 

nN 2rN r+l 1 



MISE(p nJV ) < D 



^ / \f(t)\ 2 dt. 

ZlT J\t\>c n 



[n^{c n ) (l-Y /2 ) 2 _ 
Corollary If pz(x) is a density of stable distribution and 
\Ee ttz \ = e^l'l", 6>0, < a < 2, 
then p{x) is also a stable density and for the estimator p„jv with 
N = v\og ni c„ = (Clogn) 1/a , ^>0, C>0 

MISE(p„jv) < C(logn)( 1+a )/ a x 

xn -l/(2+7 1/ "-ln2/((a-5)ln 7 )) ) a > 5 > 0. (5) 

Results of the simulation for Cauchy density are presented in FigQ] 
Remark 1 As has been shown by Stefanski and Carroll (1990) the best possible 
rates of convergence for the MISE in general deconvolution problem are usually 
(including normal and Cauchy distribution) log _p (n) for some p > 0. We see 
that in the case of the constrained deconvolution the situation is better. 
Remark 2 The above method can produce estimates which are not probability 
density functions i. e. may take negative values or/and do not integrate to 
one. It happens due to the finitcness of n. For this reason, some methods of 
modification of density estimators (all estimators, not only kernel estimators) 
has been constructed (see Glad et al (1999,2003)) in such a way that the resulting 
estimator always produces estimates which are almost surely probability density 
functions, and, in addition, the resulting estimator is better or at least almost 
as good as the initial one. 
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■ Original density 

■ Reconstructed density 
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Figure 1: The results of the reconstruction for Cauchy density (n = 1000, TV = 10 , 
7 = 1/2). 

3 Auxiliary results 

Lemma 1 For any r G (0,2] and any real characteristic function f(t) of a 
distribution with finite absolute moment (3 r of the order r the following inequality 
holds 

f(t) >l-c(r)f3 r \t\ r , 

where 

c{r) = 2/(2r) r/2 . 
Proof. First of all we prove the inequality 



cos(a:) > 1 — c{r)x r , x > 0. 

From the equality 

1 — cos(a;) \ ' x r sinx — rx r ~ 1 {\ — cos{x)) 



„1r 



we have 



/-, / w ■ , \ 1 — cos(x) x 2 r 
r(l — cos(ir)) = isin(i), ■ < , x > 



On the other hand 



1 — cos(x) 2 

— < — , x > 0. 

x r x r 



(6) 
(7) 



(8) 
(9) 



Combining © and ©, we get Q 

1 — cos(x) 2 

^ -(2^72' X> 

Finally 

/>oc />oc 

/(t) = / cos(i:r) dF{x) > (1 - c(r)|ia;| r ) dF(a:) = 1 - c(r)0 r \t\ r 
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Lemma 2 Let £ be a random variable with characteristic function f and fi- 
nite absolute moment (3 r of order r £ (0,2], then for \t\ < l/2-\/10c(r)/3 r the 
following inequality holds 



\]nf(t)\<2ny/¥WW)0r, 
where c(r) is given by Iffy. 

Proof. Since |/(i)| 2 and Re 2 f(t) are two real c.f. we have 



(10) 



< 1 - \f{t)\ 2 < 2 r+1 \t\ r c(r)p r , < 1 - Rc 2 f(t) < 2 r+1 \t\ r c(r)f3 r 



and 



sin 2 ip(t) 



Im 2 f(t) ^ 1 - |/(t)| 2 + 1 - Re 2 f(t) ^ 2 r + 2 \t\ r cfr 



< 



i/(*)i s 



< 



1 - 2 r + 1 \t\ r C p, l 



where ip(t) = arg/(£) satisfying ip(Q) = 0. The elementary inequality |a;| < 
^| since | that holds for \x\ < ir/6 entails 



\m\ < 



n / 2 r + 2 \t\ r cP r 



3 V 1 - 2- r + 1 \t\ r c(3 r 



(11) 



if |t| < l/2^/10c/3 r . Further, using the inequality | log(l - x)\ < 2\x\ , < x < 
1/2 

-ln\f(t)\ < -hn(l~2 r+1 \t\ r c(r)f3 r ) <2 r+1 \t\ r c(r)f3 r . (12) 



The combination of (fTTJl and lfT2^l gives (pT7|> . 



□ 



Lemma 3 Let us have n i.i.d random variables X\, ...,X n with common char- 
acteristic function f(t) and the underlying distribution possesses finite absolute 
moment (3 r of order r > . Then, for a > 0, < b < 2 



Pr sup |/„(0) - f(9)\ > b < 2(1 + a6(n, 6, r))e 
\|e|<a / 



-nf) 2 /144 , Yl. 



where f n (0) is the corresponding empirical characteristic function 

n 

/«(*) = -£• 



k=l 



v r is a constant not depending on j3 r , a,b and 

( Pl^n^/r 

Q(n,b,r) = < 



b 1 ^ 

V/2 1 



b 2 / r 



< r < 1 



1 < r < 2. 



Proof. Let us prove the inequality for < r < 1. Define 



15n 2 - r (3 r 



l/r 



■5 



We find numbers t\ < ti < ... < tk with the property that t\ = —a, tk = a, 
\ti — ti + i\ < 7. Clearly, we can assure this with k > 1 + 2a/ '7. We begin with 



Pr sup |/„(t) - > 6 <Pr sup \f(t) - f(s)\ > 6/3 

V|t|<a / \|t-s|<"y , 



+ Pr sup \f n {t) -f n (s)\> 6/3 j +y;Pr(|/„(ti)-/(ti)| > 6/3). 

\l*-«l<7 / i= l 

Denote the three summands on the right hand side by T\ , T2 and T3 and estimate 
them. Due to the inequality |1 — e lx \ < c(r) \x\ r that holds for < r < 1 with 
c(r) = ^4/(2r) r + l/r 2r < 5 we have 

|/(*) " f(s)\ <E\1- e«*-) x \ < c(r)E\(t - s)X\ r < c(r) 7 r & < 6/3, 

when \t — s\ < 7. Therefore, T\ — 0. Next, we let Y be the random variable 
that puts mass 1/n at each of the Xj's, then 



|/n(*) - /n(»)| < B|l - e^*— <E\(t- s)Y\ = \t- s\ 
Using the inequality 



1 ™ 

TJ ^ ' 



1 " 

n ^ — ' 



i = l 



< n 1_r ELXi| r , 0<r<l, 



(13) 



we get 



T 2 < Pr 7 



1 " 

TJ ^ ^ 



, , \ 56 1 -''3 r+1 v r 

> 6/3 < < — 

Inn 



by the Chebyshev inequality. Finally, for fixed tj, 

Pr(|/«(*i) - f(U)\ > 6/3) < Pr(Mtj) - u(fi)| > 6/6) 

+ Pr(K(«i) - «(ti)| > 6/6) < 2e-" 62 / 144 , 

by Berneistein's inequality for bounded random variables (see , for example, 
Bosq(1998)), where as usually u(i) and v(t) are the real and imaginary parts of 
f(t), and u n (t) and v n (t) are those of f n (t)- The proof in the case 1 < r < 2 
can be conducted in a similar way using the inequality 



E 



1 ™ 

T7 fc * 



<ELYi| r , r>l 



instead of fT3|l . 



□ 
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4 Proofs of the main results 

Proof of Theorem 1 Let us consider the process 

Y n (t) = V^(9n{t) - g(t)) 
with EY n {t) = 0, the cross-covariance matrix C(i, s) and 



EY n {t)Y n (s) = f(t -a)- f(t)f(s). 

The finite-dimensional distributions of Y n (t) converge by the multidimensional 
central limit theorem to those of Yp(t) as n — > oo (Ushakov (1999), Chapter 3). 
Further, it is known (see, for example, Billingsley (1968), Theorem 4.2) that if 



D 



Cun > Cu as n > OO 



for each u, 
and 
then 
Put 



D 



( u — > C aS W — > OO, 

lim lim supPr(|C„ n - T]n\ > e) = 0, 



(14) 



N oc 

Cnu = E^ 1 )^ (VU ^ = D" 1 )* 1 ^ (7**), 

fc=0 fc=0 

where = Y / n(ln.g„(t) — lng(i)). We have 

5(7 fe i) -9n{l k t) 



Pr(|CiVn-r?n| >e) =Pr 



E (- 1 ) fcy n(7 k *) > : 

k=N+l 

Pr max . , . 

\fc>Af 9yY t) 



max 

fc>AT 



1 



S 2 + 



> 2 I = f. + « (15) 



Using the Markov and Cauchy-Schwarz inequality, we have 

g{i k t) - 9n{i k t) 

{ -L) -^<j i„ ^ 7 1)1-^1) max 

=JV+lj=iV+l 



1 oo oo ✓ 

E E (-iy +j E ^( 7 W(7 

i— Nil o — Mil ^~ 



g{i k t) 



l 

< - 

- 2 



< 



E 



max 

fc>AT 



.9(7^) - 9n{l k t) 



g{i k t) 





l/2\ 


<-\l 









(16) 
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Since g(u) ^ for \u\ < t there exists b > such that g(u) > 2b on (— t, t) and 
due to Lemma 3 



P 2 < Pr max \g n (j k t) - g n (j k t)\ > b) < 

\k>N 



4(l+ 7 2Ar+1 |i|e(n,&,r))e^ + -. (17) 

n 



Further, using the elementary inequality | ln(l — z)\ < 2\z\ that holds for \z\ < 
1/2 we get 



E 



In 



( 1 9(7 k t) - 9n(7 k t) 

V gh k t) 



g(i k t) - 9n {i k t) 



g(pt k t) 



<-\\<- 



< 



ng{i k t) - 9n (i k t)\ 2 



\g(i k t)\ 2 



n\g(i k t)\ 2 



(i-\g(j k m. 



Combining (^2I> , CHI , an d using inequality \g{t)\ 2 > 1 - c(r)(3 r \t\ r (see 

Lemma 1) we get (fHE|) . Analogously 



oo oo 



Pr(|Civ - CI > e) < i E E (-!) i+j [5((7 j - 7*)*) " 5(7^)5 W)] < 



OO oo 



E E +Y t )\t\ + Y (l+3) \t\% N>N 

i=N+l j=N+l 



D 



that implies £at - * Cj N —* oo. Thus, 

M^Ut) - ln/(t)) E i^4^(7 fc *) 

and 



fc=0 



#(7 fe 



vM/n(i) - f{t)) /(t) E 



as rt — > oo. 



□ 



Proof of Theorem 2 Plancherel-Parseval formula entails 



\p(x) ~p nN {x)\ 2 dx = -!- 



n 



9n(l 2k t) fr 9 (j 2k t) 

^ 9n(i 2k+1 t) l} g(i 2k+ H) 



(It 



1 

2^ 



|/(*)| a d*. 



*|>l/ftr, 



Let us now estimate the first summand on the right-side hand. Using lemma 2 
we have for some constants C = C(r) and D = D{r) not depending on N and 



7 



h n 



\,fc=AT+l 



gh 2k t) 
g{i 2k+1 t) 



« , r(jV+l)u|r/2 

< E |ln ff (^)l<cX__W , 

fc=2(AT+l) ' 



< 



7 2(Af+l) 
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The elementary inequality \z\ < 2| ln(l — z)\ that holds for \z\ < 1/3 implies 

g(i 2k t) 



i- n 



k=N+l 



g(i 2k+1 t) 



< g ^ +1) 'f 2 , |*| < D 



1 - 7 ''/2 



T 



2(JV+1) 



Further, 



»i^*2 kjth,i 2 y ' i=0 



where 



H(t) 

Since |<7(i)| is non-increasing 
and for \t\ < l/h n 



0n(*) #0) 



9n(7*) 5(7*)' 

9{t) 



\H{t)\ < 



< 1 



A(i) 



where 



A(t) = |.9nW - ff(t)| + |fl„(7*) - .9(701- 



Further, using the equality E\g n (t) — g(t)\ = 



2 _ i-\g(t)\' 



, one gets 



E 



/ 



i/h„ 



l/hn 



N 

n 



A" 



n 



L =1 fln(7 fe g(i k t) 



di < 4c„ Pr( sup A(t) > s n )+ 

\t\<c n 



nef 



The combination of the previous estimates and some simple calculations yield 



E 



/ 



l/hn 



l/hn 



9«(7 fe - 1 i) TT 9{l k - X t) 



N 



n 



di < 8c n Pr( sup A(t) > e„) + 

|*|<c„ 



4 Ar+1 c„ 



- + 



2rJV r+1 

c-l — C>0 



(1 -7*72)2' 



where according to lemma 3 



Pr( sup A(t) > e n ) < Pr( sup |<fc,(t)-s(t)| > £„/2)+Pr( sup |<?„(7*)-<?(7*)l > e n /2) < 

|*|<c„ |t|<c„ |t|<c„ 

4(1 + c„6(n, e n /2, r)) e™ + !± 

n 

The condition p(x) € ^(K) implies (/>(•)€ ^(R) that in its turn means 



< — , x < 5 
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and therefore c n = 0{n) as n — ► oo. So. one has for some k = n{r) > and 
C > 

Pr( sup A(t) > e„) < 4 (l + n" 4 ^ 144 = 0(l/n), n oo 



|*|<c„ 



.4 



for large enough A. 

Thus, there exist constant D > such that 



\p(x) - p„n(x)\ 2 dx < D 



^ N C r , 



2rN r+1 1 



7< (l- 7 r/2)2 

Let us now estimate the last term in <|18[) . We have 



2tt 



|t|>i//i„ 



|/(t)| 2 ^. 
(18) 



E 



Since 



\f(e)\ 2 dd 



\t\>l/h n 



; Pr[l/7/„ r,/ / |/(0)| 2 d0 + / |/(0)| 2 d0. (19) 

|0|>c„ 



*7l & n 



lemma 3 yields 

Pr [l/h n < Cn] = Pr( inf \g n (9)\ < e n ) < 

\S\<c n 

Pr( sup \g n {9)-g{9)\ > d n - e n ) < 

0|<c„ 

2 (1 + c„9(n, e n , r)) e ~ n£ "/ 144 + ± = 0(l/n), n -> oo 

n 

□ 

Proof of Corollary 1. Let us put 

N = v(%, c n = (Clnn) 1 /", C>0 
Since X posesses moments of r order for r < a 

\p(x)-p nN (x)\ 2 dx<D [(Clnn) 1 /"^^^ 1 ^)^ 1112 - 1 + (Clnn)( r+1 )/ Q n™ cln7 

t 



Taking v = 2f3/rln(l/j) and C = 1/2/3(1 + (1 + 7 1/a ) - In2/rhi7) we come to 
©■ 
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